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Students hold many misconceptions as they transition from arithmetic to algebraic think¬ 
ing, and these misconceptions can hinder their performance and learning in the subject. 
To identify the errors in Algebra I which are most persistent and pernicious in terms of pre¬ 
dicting student difficulty on standardized test items, the present study assessed algebraic 
misconceptions using an in-depth error analysis on algebra students'problem solving efforts 
at different points in the school year. Results indicate that different types of errors become 
more prominent with different content at different points in the year, and that there are cer¬ 
tain types of errors that, when made during different levels of content, are indicative of math 
achievement difficulties. Recommendations for the necessity and timing of intervention on 
particular errors are discussed. 


Algebra I is a gate-keeper course determining for many 
students whether they can go on to the higher level STEM 
courses necessary for entrance into competitive 4-year col¬ 
leges (Adelman, 2006). Despite its importance, many stu¬ 
dents in the United States fail to succeed in Algebra. For 
example, 61% of students score below proficient in Pennsyl¬ 
vania (Pennsylvania Department of Education, 2011), 64% 
are less than proficient on the end-of-course Algebra I test in 
California (California Department of Education, 2014), and 
30% of students fail in Michigan (Higgins, 2008). 

The subject can be particularly challenging not only be¬ 
cause it introduces more abstract representations and more 
complex relationships between quantities, but also because 
it can magnify the misconceptions that have their roots in 
earlier instruction. A variety of particularly problematic 
misconceptions typically plague beginning algebra students, 
including believing that the equals sign is an indicator of 
operations to be performed (Baroody & Ginsburg, 1983; 
Knuth, Stephens, McNeil, & Alibali, 2006); Chesney & Mc¬ 
Neil, 2014), that negative signs represent only the subtrac¬ 
tion operation and do not modify terms (Vlassis, 2004), and 
that variables cannot represent more than one value (Knuth, 
Alibali, Weinberg, & McNeil, 2005). Unfortunately, for many 
students these misconceptions persist even after typical 
classroom instruction (Vlassis, 2004). Unaddressed, such 
misconceptions affect students success in problem solving 
(Knuth et al., 2005) and hinder their learning of new mate¬ 
rial (Booth & Koedinger, 2008). 

A number of interventions have been developed to tar¬ 
get specific misconceptions. For example, there are a variety 
of tools designed for teaching students about the relational 


nature of the equals sign, including the algebra balance scale 
(Brown, Eade, & Wilson, 1999; Vlassis, 2002; but see Filloy 
& Rojano, 1989), and a recent application using GeoGebra 
(Ko & Karadag, 2013). Similarly, there is some evidence to 
suggest that the use of Algebra Tiles can help students un¬ 
derstand variables and like terms (Confrey & Lanier, 1980; 
Kitt & Leitze, 1992; but see Askey, 1999); Belenky and Nokes 
(2009) also found that the use of manipulatives helped stu¬ 
dents correctly identify variables in algebraic word problems. 
As with all manipulatives, one issue is that teachers must 
take time to instruct students about the representations or 
manipulatives before they are used (Fueyo & Bushell, 1998; 
Uttal, Scudder, & DeLoache, 1997); if students are not ad¬ 
equately familiar with the materials, helpful tools can quickly 
become a hindrance (Booth & Koedinger, 2012). Classroom 
time constraints must be considered when interventions are 
developed; even concept-based interventions which do not 
require familiarization with alternative representations take 
time. Few would argue that students knowledge (and Alge¬ 
bra I success rates) would not improve if teachers could spend 
a class period (or more) on each prominent algebraic con¬ 
cept to ensure students gain a sound foundation. However, 
with the assessment-centered system prevalent in the United 
States, it seems highly unlikely that teachers could set aside 
a sufficient period of time to remediate each misconception. 

Given the many time constraints in the classroom, know¬ 
ing which common misconceptions most require targeted 
intervention can inform decisions about how to spend in¬ 
structional time. This requires the ability to distinguish 
between misconceptions likely to be remediated naturally 
through traditional instruction and those which remain 
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common throughout the year. We also need to understand 
which misconceptions interfere with students performance 
on summative tests. 

To accomplish this, we must have effective ways to measure 
which misconceptions are held by individual students. One 
method, frequently used in research studies, is to utilize writ¬ 
ten tests or interviews specifically designed to examine stu¬ 
dents conceptual knowledge. These measures can be effective 
at getting an in-depth understanding of a single misconception 
(Lucariello, Tine, & Ganley, 2014; Matthews, Rittle-Johnson, 
McEldoon, & Taylor, 2012), or even distinguishing between 
several misconceptions at a given time point (Booth, Lange, 
Koedinger, & Newton, 2013; Cangelosi, Madrid, Cooper, Ol¬ 
son, & Hartter, 2013). Instances of these types of assessments 
may range from 25 minutes to measure the potential miscon¬ 
ceptions in a single topic area for an entire class (Booth et al., 
2013) to 45 minutes to measure one particular misconception 
in depth simultaneously for all students in a classroom (Mat¬ 
thews et al., 2012), to 20 minutes to interview each individual 
student about particular misconceptions (Cangelosi et al., 
2013). Thus, for the purpose of comparing many misconcep¬ 
tions over a number of students over a longer period of time 
these methods are unlikely to be realistic for classroom use. 

An alternative approach involves conducting a thorough 
analysis of the misconceptions demonstrated in the prod¬ 
ucts students are already submitting: What types of errors 
are students making when they practice solving problems? 
This method does not take up any additional instructional 
time within the classroom and can be done by a teacher or 
researcher outside of the classroom. A number of studies 
have asserted that misconceptions can be effectively diag¬ 
nosed from looking at student work (e.g., Clement, 1982; 
Corder, 1982; Liebenburg, 1997). Early work documented 
the ‘bugs that students made in their problem solving efforts 
(e.g., Payne & Squibb, 1990), but application of an approach 
which tracked errors based on their source (e.g., underlying 
misconception) (Tatsuoka, 1983) has proven to be more ef¬ 
fective (Birenbaum, Kelly, & Tatsuoka, 1992). Cangelosi and 
colleagues (2013) surmised that where persistent errors exist, 
the student may be stalled at a low level of development for 
the associated concept. Consistent with this, misconceptions 
(as measured by conceptual measures like those described 
above) have been found to directly predict the types of errors 
students will make when solving problems (Booth & Koed¬ 
inger, 2008). Nesher (1987) perhaps said it best when she 
called errors the “beacons ... that mark for us the constraints 
and limitations of our knowledge (p. 37).” 

Thus, determining which errors are most persistent and 
pernicious in Algebra I can help focus the attention of both re¬ 
searchers and practitioners towards developing and utilizing 
interventions to remediate misconceptions at the most critical 
and effective times. Previous work on algebraic misconceptions 


has identified many common errors in algebra (e.g., Warren, 
2003; Vlassis, 2008; Knuth et al., 2005) and there have been 
highly useful efforts to classify these common misconceptions 
and errors (Kieran, 2007; Bush & Karp, 2012). However, few 
studies examine more than one type of misconception. In a 
notable exception, Cangelosi and colleagues (2013) find that 
negative sign errors persist beyond other types of errors for 
students enrolled in College Algebra through Calculus II. In 
another instance, middle school students misconceptions 
about the equals sign and negative sign were both found to be 
problematic for learning to solve algebraic equations (Booth 
& Koedinger, 2008). Finally, one study of Malaysian pre-al¬ 
gebra students examined the relative frequency of a variety 
of errors made when simplifying expressions; order of opera¬ 
tions and negative sign errors were among the most prevalent 
(Seng, 2010). More work like this must be conducted, perhaps 
especially with middle school Algebra students, to directly 
compare the prevalence and negative influence of different er¬ 
rors. This is the focus of the present study. 

THE PRESENT STUDY 

In the present study, we examine six categories of conceptual 
errors in students problem solving work in algebra: Errors 
indicating misunderstanding of the concepts of variables , 
negative sign , equality/inequality, operations , fractions , and 
mathematical properties. For comparison, we also consider 
the prevalence errors made in carrying out arithmetic. The 
present study answers three primary research questions. First, 
it aims to determine which of these types of errors are most 
common within a variety of topics covered in Algebra I. It 
stands to reason that certain types of errors might be present 
in one topic and not another. For instance, errors involving 
equality I inequality or variables are unlikely to occur when stu¬ 
dents are just practicing carrying out the order of operations 
in arithmetic expressions, as variables and equals signs are 
not central to those problems. Equality/inequality and vari¬ 
able errors are thus more likely to emerge in topics involving 
solving equations or inequalities. Other types of errors, such 
as those involving a negative sign or operations , may be more 
prevalent in each topic, as it is necessary to handle negative 
signs and carry out operations throughout the curriculum. 

The second purpose is to identify which are the most per¬ 
sistent errors students make while solving problems across 
Algebra I. Are there certain errors that are more common in 
one part of the year than another? For instance, certain types 
of errors which are strongly tied to concepts covered prior 
to Algebra, such as operations , fractions , and mathematical 
properties , may be more prevalent early in the year but taper 
off as students regain their footing with the relevant content. 
Other types of errors, such as equality I inequality, variables , 
and negative sign , which are tied more closely to algebraic 
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Table 1. 

Description of topics and sample items 


Topic 

Description 

Sample Items 

Order of 

Operations 

Students demonstrate knowledge of the prece¬ 
dence of completing one operation over another 
while simplifying a mathematical expression. 

Find the value of each expression. Show each 
step. 

Solving 1- and 

2-step Equations 

Students solve equations that require only one or 
two operations be completed. 

Solve each equation: 

Solving Multi-Step 
Equations 

Students solve equations that require more than 
two operations be completed. 

Solve each equation. Show all of your work. 

Systems of 
Equations 

Students find the values of a set of unknowns 
that satisfy a pair of equations using substitution 
or elimination. 

Solve the system of equations using the linear 
combination (elimination) method. Show all of 
your work. 

Inequalities 

Students graph an unequal relationship between 
values on number lines, write out mathemati¬ 
cal sentences from number lines displaying the 
inequality, and simplify inequality sentences. 

Solve the inequality. Show all of your work. 

Multiplying 

Polynomials 

Students multiply polynomials or expressions with 
two or more algebraic terms including variables 
raised to a power and multiplied by a coefficient. 

Find the product. Show all of your work. 


Note. Students completed 12 problems ranging in difficulty for each topic. 


concepts may occur more frequently as more difficult con¬ 
tent is introduced. Arithmetic errors, which are not at all tied 
to algebraic content and may perhaps be more indicative of 
attention to detail or fact memorization rather than concep¬ 
tual understanding, may be equally prevalent across the year. 

Finally, we aim to determine which of the conceptual (e.g., 
non-arithmetic) errors made at different points in the year 
are most pernicious. That is, which of the errors at which 
time points (beginning, middle, or end of year) are most pre¬ 
dictive of students difficulty when performing skills mea¬ 
sured on standardized tests? It could be that errors identified 
as most persistent are also the most problematic, in which 
case there is a clear case for remediating the associated mis¬ 
conceptions early and often. However, it is also possible that 
certain errors are more troublesome when made at one point 
of the year as compared to another; for instance, it seems 
likely that making errors related to a particular concept is 
harmless when the concept is first introduced, but more 
problematic if students continue to make those errors later 
in the school year. In these cases, intervention at particular 
time points may be critical for improving algebra success. 

METHODS 

PARTICIPANTS 

Across five school districts, 565 students (259 male, 298 fe¬ 
male, 8 unspecified) enrolled in non-honors Algebra I courses 
participated in the study, using the curriculum specified by 


their district. The school districts came from four states: Illi¬ 
nois, Ohio, Virginia, and Wisconsin. In total, there were four 
different texts used for instruction: Larson, Boswell, Kanold, 
and Stiff (2007, used by District 1 and by District 5 s high 
schools); Leiva and Brown (1997, used by District 2 and Dis¬ 
trict 3); Murdock, Kamischke, and Kamischke (2007, used by 
District 4); and Cummins, Malloy, McClain, Mojica, and Price 
(2006, used by District 5 s middle schools). The ethnicity of 
participating students was 34% Caucasian, 31% Black, 23% 
Hispanic, 10% Asian, and 2% biracial or of another race. Using 
eligibility for free or reduced lunch as a proxy, approximately 
43% of participants were classified as low-SES. A total of 37 
Algebra I classes, taught by a total of 29 teachers in 13 schools, 
were included in the study. Thirty-five percent of the students 
attended a middle school and were enrolled in grades 7 or 8; 
the remaining 65% were high school students in grades 9 or 10. 

MEASURES 

Two types of measures were utilized in the study: Assign¬ 
ments given during the school year and an assessment given 
at the end of the school year (EOY). 

Assignments 

Data consist of the students work on assignments from 
six topics over the course of the school year: Order of Op¬ 
erations (September), Solving 1- and 2-step Equations 
(October), Solving Multi-Step Equations (November), Sys¬ 
tems of Equations (January), Inequalities (February), and 
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Table 2. 

End of year assessment items sampled from standardized achievement tests 


Source 


Items 
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Jill is solving the equation 7n - 6 = 15. 
The result of her first step is In - 21. 
What operation did Jill use in her first 
step? 

a. add 6 to each side 

b. subtract 6 from each side 

c. multiply both sides by 6 

d. divide both sides by 6 


What is the slope of the line containing the 
points (-2, 5) and (1, -7)? 

a. -4 

b. -2 

c. 2 

d. 4 


The graph represents the equation y = x + 3. 



How would the graph change if the constant 
were changed from 3 to 5? 

a. The line will shift up 2 units. 

b. The line will shift down 2 units. 

c. The line will be steeper. 

d. The line will change direction. 


w 


Your teacher used the equation x + 19 = 120 when showing the class how to start to solve the following problem: 

Josie gets paid 5<t for each newspaper she delivers. She starts with 120 newspapers. If she has 19 newspapers left when she finishes, 
how much will she be paid for delivering newspapers? 

In the teachers equation, the variable x represents the number of: 

a. dollars Josie will be paid. 

b. cents Josie will be paid. 

c. cents Josie would be paid for delivering the rest of the newspapers. 

d. newspapers Josie has left. 

e. Newspapers Josie delivered. 
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Which is one value of the set of x that makes the following true? 


7x + 3> 17 


'S Oh 
£ C/D 


a. 0 

b. 1 

c. 2 

d. 3 
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Which of the following equations repre¬ 
sents the relationship between x and y in 
the table? 
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a. y = 2x 

b. y = * + 2 

c. y = 5x 

d. y - 3x + 2 


Amy has of a yard of string to make brace¬ 
lets. Each bracelet requires of a yard of string. 
What is the greatest number of bracelets Amy 
can make with this length of string? 

a. 8 

b. 6 

c. 4 

d. 3 


Which has a value between 2 and 3? 

a. Vl2 

b. V8 

c. V3 

d. V2 
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The graph to the right summarizes Sashas bicycle trip. 
Which statement best describes Sashas bicycle trip? 

a. Sasha stopped riding her bike. 

b. Sasha stayed home and time ran out. 

c. Sasha rode her bicycle towards home. 

d. Sasha started her bicycle trip from home. 


Sasha's 



Time (in minutes) 


The expression below represents the num¬ 
ber of flowers Ian used in his bouquets: 

3(12 + 7) 

Kate used the same number of flowers as 
Ian. Which expression represents the num¬ 
ber of flowers that Kate used? 

a. 15x7 

b. 36x7 

c. 15 + 21 

d. 36 + 21 


docs.lib.purdue.edu/jps 


13 


2014 | Volume 7 









































































J. L. Booth, C. Barbieri, F. Eyer, & E. }. Pare-Blagoev 


Persistent and Pernicious Errors in Algebraic Problem Solving 


Polynomials (April). Each assignment consisted of 12 prob¬ 
lems for students to solve. The assignments were created by 
the research team as control assignments for a larger study; 
each control assignment was designed to be compatible with 
all of the curricula used by the participating school districts 
and utilized problems that were isomorphic to those in the 
textbooks. A description of the topic as well as sample items 
from each assignment can be found in Table 1. 

EOY assessment 

At the end of the school year (EOY), students were adminis¬ 
tered a paper-and-pencil test consisting of 10 Algebra-related 
released items taken from the five standardized tests used by 
the participating districts: Ohio Achievement Test—Grade 8 
(3 items; Ohio Department of Education, 2006); Standards 
of Learning Test—Grade 8 Mathematics (1 item; Virginia 
Department of Education, 2008), Illinois Standards Achieve¬ 
ment Test—Grade 8 Math (3 items; Illinois State Board of 
Education, 2009), Wisconsin Knowledge and Concepts Ex¬ 
amination-Grade 8 Mathematics (2 items; Wisconsin De¬ 
partment of Public Instruction, 2006), and the EXPLORE 
test (1 item; ACT, Inc., 2014). Eighth grade test items were 
used because they were closest to Algebra I content and be¬ 
cause the next testing grade level available (11 th ) was higher 
than that of any participating student. Particular items were 
chosen for their relevance to Algebra I curriculum topics; see 
Table 2 for a list of the items used and their sources. For each 


Figure 1. 

Example coding of multiple errors in a single problem re¬ 
sponse. In his first step, the student 1) subtracts 4x when the 
4x is already negative {negativesign error), and 2) subtracts the 
4x twice from the same side of the equation {equality/inequal¬ 
ity error). Then, he when subtracting the -4x from the -6x, he 
ignores the negative sign he added and computes the sum as 
-2x {negative sign error). Thus, in a single problem, this student 
made two negative sign errors and one equality/inequality error. 



student, the percentage of problems they answered correctly 
on the EOY test was computed. 

PROCEDURE 

As control participants in a larger intervention study, these 
students completed practice assignments throughout the 


Table 3. 

Categories and descriptions of conceptual errors by topic 


Error category 

Specific errors 

Order of 
Operations 

1-Step 

Equations 

Multi-Step 

Equations 

Systems of 
Equations 

Inequalities 

Polynomials 

Variable 

Combining unlike terms; moving, deleting, or adding a variable 

X 

X 

X 

X 

X 

X 

Solving for only one variable 

- 

- 

- 

X 

- 

- 

Negative Sign 

Moving, deleting, or adding a negative sign, including subtracting 
when addition is indicated or addition when subtraction is indicated. 

X 

X 

X 

X 

X 

X 

Moving a term without changing its sign 

- 

X 

X 

X 

X 

- 

Equality/ 

Inequality 

Moving, deleting, or adding an equals sign; performing operations with¬ 
out maintaining balance on both sides of the equals or inequality sign 

X 

X 

X 

X 

X 

X 

Changing/not changing the direction of the inequality sign when 
inappropriate 

- 

- 

- 

- 

X 

- 

Operation 

Performing addition or subtraction when multiplication or divi¬ 
sion is indicated, or vice versa. 

X 

X 

X 

X 

X 

X 

Mathematical 

Property 

Inappropriately applying the commutative or associative property 

X 

X 

X 

X 

X 

X 

Inappropriately applying the distributive property 

- 

- 

X 

X 

X 

X 

Fraction 

Moving a term from the numerator to the denominator or vice 
versa; performing multiplication when division is indicated by the 
fraction bar; using addition or subtraction to eliminate a numera¬ 
tor or denominator 

X 

X 

X 

X 

X 

X 

Note, x Applicable in this topic. — Not applicable in this topic. 
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Table 4. 

Sample student work demonstrating each conceptual error category 


Error Example 


jS 


9z + 1 becomes lOz 

7. 2 + 9z = 1 - 6z 
'2 ~2 


-Vl Jrl 


6x 2 + 4x becomes 10x 3 

8. (6jc 2 + 4x)(x 3 

A * I / . _ 


3v and 3 are considered the same 


6. 8 = 7+4v —3v 



i OX- 3 

(/Oxi) 0'3) 


Hv 


-V 


,§o 


8 - (-2) becomes -10 

I 8-(2--6) 


-2x becomes 2x 



2-O+fe) 

-10 


3 


» 5 


9z is moved without changing the sign 

7. 2 + 9z = l-6z 

A l 

1 - I-It. 

hJ_ 

3=3 7. 

\=z 


o 

5h 

5h 

<D 

53 

3 

'S- 1 

I 

'S- 1 


Equals sign is dropped from the equation 

7. 2 + 9z = \-6z 

i-3 

'LL - I 


7 is subtracted from only one side of the 
equation 

6. 8 = 7 + 4v — 3v 

'7 


Did not change direction of sign after divi¬ 
sion by a negative 8 - 3v ~ 9 - 2 v "' 





-3x > 2 * ** 
_2_* ~L* 

T 5 * -T 


A — 


5 + x becomes 5x 


+1 

0 

Jh 

+K OK 

K 

O 


! 

o' 

5 5 


y- -l.fc 


-19/-9 is treated like -19-9 

9. -5(y + 2) = 9-4/ 

T i0 ^4 

:n--LL 

-q -q 
-2S -J 


6 - 4x treated like 6 • 4x 


3H 


G-My - 




y =9ao 


AS 


3w - 7 is treated like 7 - 3w 


^Q. - rg\0 

\3 jUfbJ 

i l 


Does not distribute entire binomial to entire 
binomial 

6. (jr + 4) : 


/ y HlWVU ) 


q-49-1 


k v 


V 2 is only distributed to the m in (m + 6) 

11. i(iM + 6) = 7-3»t 

VC-7 

yn»- 


Denominator and numerator are combined 
5 


-1/15 becomes -15 


c/3 

3. =9 

2d-4 


7. 2 + 9z = l-6z 

O 



»-( 

<u 

2d-20 = 

9 


.0 

^ q 

1-q 

-z_ 

+ - / 

tj 

1 

A 

Lia 

9- 

1 5 )3~ 


iAi 

f 



Subtracted both sides by 4 to get rid of the 
denominator 


Solve each equation: 

^ = 5 


q-k* = 4 

5 -(f/ - s 
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school year. Teachers could decide which assignments to 
use and when to use them as consistent with their syllabus, 
curriculum, and state standards. Although all assignments 
were not used by all teachers in the study, those assignments 
that were used were completed in the same order as listed 
previously. Assignments were used for practice in class or as 
homework, as deemed appropriate by the classroom teacher. 
During a class period at the end of the school year, teachers 
administered the EOY assessment to all students. 

CODING 

Student work on the six practice assignments was coded in 
terms of six types of conceptual errors made while solving 
the problems: Variable errors, Negative Sign errors, Equality/ 
Inequality errors, Operation errors, Mathematical Property 
errors, and Fraction errors. A single coder was utilized for 
all of the date to ensure consistency across assignment top¬ 
ics. Table 3 illustrates the categories of conceptual errors sub¬ 
sumed in the category for each topic area. Table 4 presents 
student work samples demonstrating examples of each type 
of conceptual error. In addition to the six conceptual errors, 
student work was coded for Arithmetic errors (computing an 
arithmetic calculation inaccurately, e.g., 5 + 7=11; 4/8 = 3) 
made during problem solution. As demonstrated in Figure 
1, student work for a single problem—or even a single step 
within a problem—could be classified as having multiple er¬ 
rors, but each individual instance of a mistake was only clas¬ 
sified into one error type. The number of each type of error 
made on each topic was computed for each student. 

We also computed the average number of each type of er¬ 
ror made in each trimester, beginning vs. the middle vs. the 
end of the year, which reflects the frequency of each error 
type on easy vs. moderate vs. harder content. Beginning of 
year assignments were order of operations and 1- and 2-step 
equations. Middle assignments were multi-step equations 
and systems of equations. End assignments were Inequalities 
and Polynomials. If students did not complete one of the two 
assignments in that trimester, the frequency of each error 

Table 5. 

RM ANOVA comparing errors by topic. 


made on the other assignment was used as the score for that 
trimester. 

RESULTS 

Figure 2 shows the frequency of each error type made on 
each assignment topic. Note that because individual teachers 
could decide whether or not to use a particular assignment, 
the number of students varied for each topic. To determine 
which types of errors were most common within each topic 
area, we conducted a series of Repeated Measures ANOVAs, 
one for each topic, on the number of each error category 
made on that topic s assignment; the data were also analyzed 
by estimating a Bayes factor using Bayesian Information Cri¬ 
teria (Wagenmakers, 2007), which compares the fit of the 
data under the null hypothesis with that for the alternative 
hypothesis. Significant main effects of error category were 
found for each topic, indicating that the frequency of dif¬ 
ferent types of errors varied within each topic. Results are 
reported in Table 5. 

Follow-up paired-sample t-tests with Bonferroni correc¬ 
tions were conducted on each pair of error types within a 
topic. As shown in Figure 2, the most common errors for the 
Order of Operations assignment were arithmetic errors and 
negative sign errors. For 1-step equations, the most frequent 
were negative sign errors followed by fractions errors. For 
Multi-step equations, negative sign errors were most com¬ 
mon followed by fractions and arithmetic errors. For Systems 
of equations, negative sign errors were most common, fol¬ 
lowed by variable and arithmetic errors. For Inequalities, the 
most frequent were Equality/Inequality errors followed by 
negative sign errors. Finally, for Polynomials, the most fre¬ 
quent errors were those with variables followed by negative 
sign errors. 

To determine which types of errors are most persistent 
over the course of Algebra I content, we conducted a 3 (tri¬ 
mester: beginning vs. middle vs. end) x 7 (error type) Re¬ 
peated Measures ANOVA. Mauchlys test of sphericity 


Topic 

F 

df 

V 

BF 

Order of Operations 

118.23*** 

(6, 2904) 

.20 

1.18 x 10 15 

1- step equations' 1 

265.03*** 

(2.06, 913) 

.37 

3.13 x 10‘ 44 

Multi-step equations' 1 

173.79*** 

(2.88, 1333.82) 

.27 

5.16 x 10‘ 29 

Systems of equations' 1 

189.54*** 

(3.18, 1036.14) 

.37 

2.85 x 10' 29 

Inequalities' 1 

281.00*** 

(6, 2484) 

.40 

1.49 x 10‘ 39 

Polynomials 

105.12*** 

(6, 2502) 

.20 

2.88 x 10 13 

Note. *** p < .001; BF = Estimated Bayes Factor 

a Mauchlys test of sphericity indicated violation of sphericity assumption so degrees of 
freedom were adjusted using Greenhouse-Geisser correction. 
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Figure 2. 

Frequency of each type of error within each assignment topic 



Order of 

1-Step 

Multi-Step 

Systems of Inequalities 

Polynomials 

Operations 

Equations 

Equations 

Equations 


(N=485) 

(N=445) 

(N=465) 

(N=327) (N=416) 

(N=418) 

■ Variable 



■ Negative sign 


■ Equals sign 


■ Wrong operation 


■ Mathematical properties 

■ Fractions 



Figure 3. 

Frequency of each error type during each trimester 


Types of Errors by Trimester 



^—Variable 
Negative 
^—Equals sign 

Wrong operation 
^—Mathematical properties 
^—Fraction 
Arithmetic 


Note : Error bars indicate standard errors. 

indicated violations of the sphericity assumption so degrees 
of freedom were adjusted using Greenhouse-Geisser cor¬ 
rections for main effects of error type and trimester as well 
as the interaction between error type and trimester. The 


analysis yielded a significant main effect of error type, F(3.12, 
1367.99)=317.31, p < .001, r| p 2 =.42. An estimated Bayes fac¬ 
tor (null/alternative) suggested that the data were 1.52 x 10 48 :1 
in favor of the alternative hypothesis, or rather, 6.58 x 10 47 
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Table 6. 

Correlations between EOY score and each type of error for each topic. 



Beginning 

Middle 

End 

Variable 

-.18*** 

_ 18*** 

-.08 

Negative Sign 

-.18*** 

-.14*** 

-.19*** 

Equality/Inequality 

-.09* 

17*** 

17*** 

Wrong Operation 

-.16*** 

-.16*** 

-.08 

Mathematical 

Property 

17*** 

-.10* 

-.07 

Fraction 

-.02 

-.01 

-.15*** 

Arithmetic 

-.10* 

-.11** 

_ 18*** 

Note. ***p<. 001; **p<.01; *p <.05 


Table 7. 

Predictors of end of year (EOY) assessment. 



p 

B 

SE 

Equality/Inequality Errors: 1st trimester 

-.07 

-.04 

.03 

Equality/Inequality Errors: 2nd trimester 

17*** 

-.03*** 

.01 

Equality/Inequality Errors: 3rd Trimester 

-.15*** 

-.03*** 

.01 

Negative Sign Errors: 1st trimester 

-.05 

-.01 

.01 

Negative Sign Errors: 2nd trimester 

.03 

.00 

.00 

Negative Sign Errors: 3rd Trimester 

-.08 f 

-.01 f 

.01 

Variable Errors: 1st trimester 

-.10* 

-.04* 

.02 

Variable Errors: 2nd trimester 

-.03 

.00 

.01 

Mathematical Property Errors: 1st trimester 

-.10* 

-.04* 

.02 

Mathematical Property Errors: 2nd trimester 

-.09* 

-.04* 

.02 

Wrong Operation Errors: 1st trimester 

-,09 f 

-.04 f 

.02 

Wrong Operation Errors: 2nd trimester 

-.08 f 

-.04+ 

.02 

Fraction Errors: 2nd trimester 

-.04 

-.03 

.04 

Arithmetic Errors: 1st trimester 

-.02 

-.01 

.01 

Arithmetic Errors: 2nd trimester 

.00 

.00 

.01 

Arithmetic Errors: 3rd trimester 

-.11** 

-.05** 

.02 

R 2 

.216 

F 

7.27*** 

trending atp<.10 level .*p < .05 level. **p < .01 level. ***p < .001 level. 


times more likely to occur under a model including an effect of 
error type, rather than a model without it. Follow-up paired- 
samples t-tests with Bonferroni corrections demonstrated that 
the frequency of errors across all topics and trimesters in de¬ 
scending order was as follows: negative sign errors (M = 1.96), 
arithmetic (M = .80) and variable errors (M = .77), equals 
sign errors (M = .55), fraction errors (M = .43), mathematical 
properties errors (M =.30), and wrong operation errors (M = 
.21). Contrasts were significant at the p < .001 level with the 
exception of arithmetic and variable errors which were not 


significantly different from each other. The main effect of tri¬ 
mester was also significant, F( 1.66, 727.28) = 141.79, p < .001, 
q p 2 =.25; the estimated Bayes factor suggested the data were 2.96 
x 10 25 :1 in favor of the alternative hypothesis, or 3.37 x 10 24 
times more likely to occur under a model including an effect 
of trimester. Follow-up paired-samples t-tests with Bonferroni 
corrections revealed significant differences in the number of 
errors made between all three trimesters (p < .001). Frequency 
of errors in ascending order was as follows: beginning of the 
year (M =.46), end of the year (M =.59), and middle of the year 
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(M = 1.10). The interaction between error type and trimester 
was also significant, T(6.13,2683.66)=106.64,p < .001, r| p 2 =.20; 
the estimated Bayes factor suggested the data were 2.13 x 10 
13 :1 in favor of the alternative hypothesis, or 470 billion times 
more likely to occur under a model including an interaction 
between error type and trimester. To interpret the interaction, 
we calculated simple effects with separate Repeated Measures 
ANOVAs on trimester, one for each error type. As shown in 
Figure 3, negative sign , fraction , and arithmetic errors were 
most prevalent in the middle of the school year, followed by 
the beginning, and then the end of the year (allps < .001). In 
contrast, equals sign , wrong operation, and mathematical prop¬ 
erties errors were most common at the end of the school year. 
Variable errors were equally prevalent in the middle and end 
of the school year. 

To determine which types of errors are most problematic 
for student performance on standardized test items, we first 
correlated each of the error types in each trimester with stu¬ 
dent scores on the EOY test. As shown in Table 6, sixteen 
error/trimester combinations were significantly negatively 
correlated with EOY test scores, suggesting that as instances 
of each error increased, student EOY scores decreased. 

To determine which of those sixteen error/trimester com¬ 
binations were most pernicious, we regressed EOY scores on 
the number of each type of error made for each trimester in 
which the correlation was significant. Results are presented 
in Table 7. Nine factors emerged as independent predictors 
of EOY scores: making more variable errors at the beginning 
of the year (on simpler content), making more mathemati¬ 
cal property and wrong operation errors at the beginning and 
middle of the year (on simple and moderate content), mak¬ 
ing more equality/inequality errors in the middle and end of 
the year (on increasingly more difficult content), and making 
more negative sign and arithmetic errors at the end of the year 
(on difficult content) all predict lower EOY test scores. 

DISCUSSION 

Results from this study suggest that, while students make a 
variety of conceptual errors when solving algebra problems 
over the course of the school year, there are some interesting 
patterns in the types of errors they make, when they make 
them, and how problematic they are. For instance, negative 
sign errors were by far the most prominent during the school 
year as a whole, and they were consistently prominent across 
each of the six topics in the study. Negative sign errors seem 
to be most prevalent in the middle of the school year, when 
students are learning to solve more complex equations or 
systems of equations. Of course, the frequency of the error is 
not necessarily a reason for concern; it is important to note 
that if students make these errors during the beginning or 
middle of the school year, it is not yet indicative of difficulty 


achieving in mathematics. This suggests that intervention 
on negative sign errors earlier in the school year beyond 
what is done in typical instruction may not be necessary, 
even though they are occurring frequently. There is more 
reason for concern with the students who are still making 
many negative sign errors towards the end of the year. In¬ 
tervention and conceptual remediation may be necessary to 
help these students succeed in algebra. A surprisingly lim¬ 
ited amount of research has been conducted on students 
understanding of negative numbers (Kieran, 2007), how¬ 
ever, the use of number lines and set models may help stu¬ 
dents to develop a stronger understanding (Altiparmak & 
Ozdogan, 2010; Ashlock, 2006); this suggestion is consistent 
with the recommendation to model with mathematics in the 
Common Core State Standards for Mathematics (NGA & 
CCSSO, 2010). 

Equality/inequality errors tend to emerge as students 
gain more experience solving equations (or inequalities), 
and continue to increase through the end of the school year. 
Consistent with this pattern, making equality/inequality er¬ 
rors during either the middle or end of the year—when they 
are becoming more prominent—is a troublesome sign for 
students math achievement. Perhaps this is not surpris¬ 
ing, given that the notion of balance across two sides of an 
equation is one of the most foundational concepts underly¬ 
ing algebra and that students have difficulty moving from an 
operational to a relational understanding of the equals sign 
(e.g., Chesney & McNeil, 2014). Perhaps having an opera¬ 
tional understanding is sufficient for performance on simple 
equations, but the lack of a relational understanding be¬ 
comes more problematic when students face more complex 
equations. Results from this study suggest that any classroom 
time devoted to improving students conceptual understand¬ 
ing of the equals sign is likely well spent; fortunately, a variety 
of tools, materials, and instructional suggestions are already 
available for this purpose, including utilizing a balance scale 
(Vlassis, 2002) or introducing arithmetic sentences that are 
in unconventional forms, such as 7 = 2 + 5, etc. (McNeil, 
Fyfe, Petersen, Dunwiddie, & Brletic-Shipley, 2011). 

Two types of errors dealing with more basic arithmetic 
concepts are those involving performing the wrong opera¬ 
tion , and those violating mathematical properties of number. 
Neither of these is among the most prominent errors made 
in any of the six topics. Ffowever, students who begin the year 
making these errors are more likely to struggle to achieve in 
mathematics. This is not surprising as both concepts have 
their root in the lessons they have been taught since the be¬ 
ginning of their school career. Based on the Common Core 
State Standards for Mathematics which, for these topics, 
broadly mirror the timelines that were likely in place when 
these data were collected, students begin working with addi¬ 
tion and subtraction as early as kindergarten, and continue 
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on to multiplication and division by third grade (NGA & 
CCSSO, 2010). By the time students complete elementary 
school, they are to be fluent in basic facts with all four op¬ 
erations, and should have begun using those operations to 
complete computations with whole numbers, decimals, and 
fractions (NGA & CCSSO, 2010). Similarly, students begin 
working with the commutative and associative properties 
of addition in first grade. By third grade they are using the 
commutative and associative properties of multiplication 
and learning the distributive property (NGA & CCSSO, 
2010). If students begin algebra still misunderstanding these 
operations and properties they have been practicing for 
years, they clearly should have difficulty achieving in alge¬ 
bra. Warren (2003) suggests that these misconceptions per¬ 
sist because students are not provided with enough time to 
explore the number and operation systems prior to middle 
school; these types of misunderstandings can be cleared up 
in elementary school by having students justify their use of 
properties of numbers, similar to how it is done in geometry 
proofs (Carpenter, Levi, & Farnsworth, 2000). Further re¬ 
search is needed to determine whether remediation of these 
basic concepts is effective during algebra courses, or if these 
concepts should be heavily reinforced in earlier years for 
students who demonstrate relevant misconceptions. 

Variable errors appear to increase toward the middle and 
end of the year, when students are dealing with more complex 
equations. However, it is those made at the beginning of the 
year, when students are just learning to solve simple equations, 
that are indicative of difficulty in math achievement. This may 
indicate that making variable errors when there are many com¬ 
ponents to juggle within an equation is understandable and 
indicative of a student with average ability. However, making 
variable errors when there is only one variable to work with 
might be indicative of a student who is lacking a key under¬ 
standing of variables that will be an obstacle in progressing in 
algebra. This suggests that ensuring students develop a sound 
understanding of the concept of variables, particularly their 
understanding of which terms are like and which are unlike, 
could be a good candidate for intervention in the beginning 
of algebra courses. Effective instructional techniques for this 
purpose include using representations such as tables and area 
models to represent algebraic expressions (Swan, 2000; Ross 
& Willson, 2012). Additionally, researchers suggest providing 
experience with software that allows them to manipulate visu¬ 
al objects without using algebraic symbols (Yerushalmy, 1997), 
perhaps like the increasingly popular app DragonBox Algebra 
5+ (WeWantToKnow, 2012). 

Interestingly, though fraction errors were prominent, es¬ 
pecially in the middle of the year, they were not indicative 
of difficulty on our math achievement measure. This is sur¬ 
prising, given that fraction knowledge has been shown to be 
highly predictive of future math achievement (Siegler et al., 


2012), critical for algebra readiness (Booth & Newton, 2012), 
performance, and learning (Booth, Newton, & Twiss-Garrity, 
2014), and is hypothesized to be one of the most important 
factors in algebra achievement (NMAP, 2008). One reason 
for the apparent discrepancy may be that scholars have iden¬ 
tified foundational knowledge of the magnitudes of fractions, 
and the understanding of fractions as numbers, as the critical 
knowledge components impacting algebra (e.g., Booth et al., 
2014; Empson & Levi, 2011). In the present study, fraction 
errors do not represent students misunderstanding of the 
values of fractions themselves, but their misunderstanding 
of the relationships between the numerators and denomina¬ 
tors. Still, it is surprising that this misunderstanding is not 
detrimental to achievement in the present study. Ongoing 
work on the relationship between fraction knowledge and 
algebra achievement might directly test whether students 
understanding of the components of fractions contributes at 
all beyond that of the magnitudes of fractions as a whole. 

Finally, arithmetic errors, though not indicative of any 
type of misconception, are quite prominent, and were most 
prevalent in the middle of the school year, when students 
are learning to solve more complex equations or systems of 
equations. Again, frequency of errors is not necessarily rea¬ 
son for concern; indeed, making frequent arithmetic errors 
at the beginning and middle of the school year is not indica¬ 
tive of difficulty with mathematics achievement. Instead, it 
is arithmetic errors being made at the end of the school year, 
on the most difficult content, that is reason for concern. It 
is also interesting to note that despite the prominence of 
arithmetic errors, many conceptual errors emerge as predic¬ 
tors of difficulty with mathematics achievement above and 
beyond that of arithmetic errors, again reinforcing that the 
frequency of an error alone should not be used to determine 
how concerning that error might be. While results regarding 
arithmetic errors do not suggest the necessity of any concep¬ 
tual remediation, they may indicate that students who make 
many careless mistakes might require a different sort of in¬ 
tervention to reinforce basic arithmetic facts or to help them 
focus on the task at hand. 

One obvious limitation of this study, though critical for 
practical implementation in real-world classrooms, is that stu¬ 
dents completed certain assignments at certain points in the 
school year, when relevant for their curriculum. Thus, it is not 
clear whether making an error at the beginning of the year is 
necessarily indicative of a carryover misconception from prior 
years or if certain types of content in the context of certain 
curricula are more likely to elicit certain types of errors. Truly 
teasing apart the effect of time of year from the effect of assign¬ 
ment topic would require administration of the same assign¬ 
ment (or assignment type, at least) at multiple points in the 
school year. Further, it would be interesting to compare the 
likelihood of errors across curricula. It is also critical to note 
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that a given error may be indicative of more than one mis¬ 
conception. For example, if a student moves a term without 
changing its sign, they may not understand the meaning of the 
negative sign, but they may also have difficulty understanding 
the relational nature of the equals sign and how the operations 
completed on each side must keep the equation in balance. 

Nevertheless, the results from this study suggest that the 
misconceptions underlying specific persistent errors are not 
corrected through typical instruction and may require ad¬ 
ditional intervention in order for students to learn correct 
strategies, whether it be through interventions targeting 
individual misconceptions, or curricula generally aimed at 
improving conceptual understanding throughout the course 
(e.g., Cai, Moyer, Wang, & Bikai, 2011; Booth, Oyer, Pare- 
Blagoev, Elliot, Barbieri, Augustine, & Koedinger, under 
review). Results from the present study also indicate that 
some errors are more pernicious than others. In particular, 
it appears that students who make mathematical properties 
and operation errors on easy to moderate content, those 
who make variable errors (such as combining unlike terms) 
when solving early equations, and those who are still making 
equality/inequality and negative sign errors on more complex 
problems will have the most trouble succeeding in Algebra I. 
These errors, and their underlying misconceptions, may per¬ 
haps be the most important targets for intervention in and 
out of the classroom. 
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